2026-10-26 12:13:35,319 [ 270964 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2026-10-26 12:13:35,320 [ 270964 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2026-10-26 12:13:35,320 [ 270964 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2026-10-26 12:13:35,320 [ 270964 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_zg7bhh --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=2993bc2bf171 -e DOCKER_KERBERIZED_HADOOP_TAG=ce74919e88f5 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=a2d3dc777d0c -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_drop_if_empty/test.py::test_drop_if_empty test_drop_replica_with_auxiliary_zookeepers/test.py::test_drop_replica_in_auxiliary_zookeeper test_failed_async_inserts/test.py::test_failed_async_inserts test_fetch_memory_usage/test.py::test_huge_column test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts test_fix_metadata_version/test.py::test_fix_metadata_version test_freeze_table/test.py::test_freeze_table test_grant_and_revoke/test.py::test_allowed_grantees test_grant_and_revoke/test.py::test_current_database test_grant_and_revoke/test.py::test_current_grants_override test_grant_and_revoke/test.py::test_grant_all_on_table test_grant_and_revoke/test.py::test_grant_current_grants test_grant_and_revoke/test.py::test_grant_current_grants_with_partial_revoke test_grant_and_revoke/test.py::test_grant_option test_grant_and_revoke/test.py::test_grant_with_replace_option test_grant_and_revoke/test.py::test_implicit_create_temporary_table_grant test_grant_and_revoke/test.py::test_implicit_create_view_grant test_grant_and_revoke/test.py::test_implicit_show_grants test_grant_and_revoke/test.py::test_introspection test_grant_and_revoke/test.py::test_revoke_requires_grant_option test_grant_and_revoke/test.py::test_smoke test_group_array_element_size/test.py::test_max_exement_size test_host_regexp_multiple_ptr_records_concurrent/test.py::test_host_regexp_multiple_ptr_v4 test_http_native/test.py::test_http_native_returns_timezone test_insert_into_distributed_through_materialized_view/test.py::test_inserts_local 'test_insert_over_http_query_log/test.py::test_insert_over_http_exception[0]' 'test_insert_over_http_query_log/test.py::test_insert_over_http_exception[1]' test_insert_over_http_query_log/test.py::test_insert_over_http_invalid_statement test_insert_over_http_query_log/test.py::test_insert_over_http_ok test_insert_over_http_query_log/test.py::test_insert_over_http_unknown_table test_inserts_with_keeper_retries/test.py::test_query_timeout_with_zk_down test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_disconnect test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_restart test_jbod_balancer/test.py::test_jbod_balanced_merge test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch test_jbod_ha/test.py::test_jbod_ha test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin test_keeper_and_access_storage/test.py::test_create_replicated test_keeper_availability_zone/test.py::test_get_availability_zone test_keeper_force_recovery/test.py::test_cluster_recovery test_keeper_force_recovery_single_node/test.py::test_cluster_recovery test_keeper_four_word_command/test.py::test_cmd_clrs test_keeper_four_word_command/test.py::test_cmd_conf test_keeper_four_word_command/test.py::test_cmd_cons test_keeper_four_word_command/test.py::test_cmd_crst test_keeper_four_word_command/test.py::test_cmd_csnp test_keeper_four_word_command/test.py::test_cmd_dump test_keeper_four_word_command/test.py::test_cmd_isro test_keeper_four_word_command/test.py::test_cmd_lgif test_keeper_four_word_command/test.py::test_cmd_mntr test_keeper_four_word_command/test.py::test_cmd_rqld test_keeper_four_word_command/test.py::test_cmd_ruok test_keeper_four_word_command/test.py::test_cmd_srst test_keeper_four_word_command/test.py::test_cmd_srvr test_keeper_four_word_command/test.py::test_cmd_stat test_keeper_four_word_command/test.py::test_cmd_wchc test_keeper_four_word_command/test.py::test_cmd_wchp test_keeper_four_word_command/test.py::test_cmd_wchs test_keeper_four_word_command/test.py::test_cmd_ydld test_keeper_four_word_command/test_allow_list.py::test_allow_list test_keeper_internal_secure/test.py::test_secure_raft_works test_keeper_internal_secure/test.py::test_secure_raft_works_with_password test_keeper_mntr_data_size/test.py::test_mntr_data_size_after_restart test_keeper_mntr_pressure/test.py::test_aggressive_mntr test_keeper_nodes_move/test.py::test_node_move test_keeper_persistent_log/test.py::test_ephemeral_after_restart test_keeper_persistent_log/test.py::test_state_after_restart test_keeper_persistent_log/test.py::test_state_duplicate_restart test_keeper_reconfig_add/test.py::test_reconfig_add test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 test_keeper_s3_snapshot/test.py::test_s3_upload test_keeper_secure_client/test.py::test_connection test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout test_library_bridge/test.py::test_load_all test_library_bridge/test.py::test_load_all_many_rows test_library_bridge/test.py::test_load_ids test_library_bridge/test.py::test_load_keys test_library_bridge/test.py::test_null_values test_library_bridge/test.py::test_path_validation test_library_bridge/test.py::test_recover_after_bridge_crash test_library_bridge/test.py::test_server_restart_bridge_might_be_still_alive test_library_bridge/test.py::test_ssrf test_library_bridge/test_exiled.py::test_bridge_dies_with_parent 'test_log_family_s3/test.py::test_log_family_s3[Log]' 'test_log_family_s3/test.py::test_log_family_s3[StripeLog]' 'test_log_family_s3/test.py::test_log_family_s3[TinyLog]' test_lost_part/test.py::test_lost_last_part test_lost_part/test.py::test_lost_part_mutation test_lost_part/test.py::test_lost_part_other_replica test_lost_part/test.py::test_lost_part_same_replica test_max_rows_to_read_leaf_with_view/test.py::test_max_rows_to_read_leaf_via_view test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size test_memory_limit_observer/test.py::test_observe_memory_limit test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error -vvv" altinityinfra/integration-tests-runner:9d492c2eec24 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: order-1.0.1, random-0.2, timeout-2.2.0, repeat-0.9.3, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_log_family_s3/test.py::test_log_family_s3[Log] test_lost_part/test.py::test_lost_last_part test_inserts_with_keeper_retries/test.py::test_query_timeout_with_zk_down test_keeper_four_word_command/test.py::test_cmd_clrs test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used test_grant_and_revoke/test.py::test_allowed_grantees test_library_bridge/test.py::test_load_all test_insert_over_http_query_log/test.py::test_insert_over_http_exception[0] test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_keeper_persistent_log/test.py::test_ephemeral_after_restart [gw4] [ 1%] PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes [gw0] [ 2%] PASSED test_keeper_four_word_command/test.py::test_cmd_clrs test_keeper_four_word_command/test.py::test_cmd_conf [gw0] [ 3%] PASSED test_keeper_four_word_command/test.py::test_cmd_conf test_keeper_four_word_command/test.py::test_cmd_cons [gw4] [ 4%] PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk [gw0] [ 5%] PASSED test_keeper_four_word_command/test.py::test_cmd_cons test_keeper_four_word_command/test.py::test_cmd_crst [gw0] [ 6%] PASSED test_keeper_four_word_command/test.py::test_cmd_crst test_keeper_four_word_command/test.py::test_cmd_csnp [gw0] [ 7%] PASSED test_keeper_four_word_command/test.py::test_cmd_csnp test_keeper_four_word_command/test.py::test_cmd_dump [gw0] [ 8%] PASSED test_keeper_four_word_command/test.py::test_cmd_dump test_keeper_four_word_command/test.py::test_cmd_isro [gw0] [ 9%] PASSED test_keeper_four_word_command/test.py::test_cmd_isro test_keeper_four_word_command/test.py::test_cmd_lgif [gw4] [ 10%] PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin [gw0] [ 11%] PASSED test_keeper_four_word_command/test.py::test_cmd_lgif test_keeper_four_word_command/test.py::test_cmd_mntr [gw4] [ 12%] PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin [gw0] [ 13%] PASSED test_keeper_four_word_command/test.py::test_cmd_mntr test_keeper_four_word_command/test.py::test_cmd_rqld [gw1] [ 14%] PASSED test_grant_and_revoke/test.py::test_allowed_grantees test_grant_and_revoke/test.py::test_current_database [gw6] [ 15%] PASSED test_keeper_persistent_log/test.py::test_ephemeral_after_restart test_keeper_persistent_log/test.py::test_state_after_restart [gw0] [ 16%] PASSED test_keeper_four_word_command/test.py::test_cmd_rqld test_keeper_four_word_command/test.py::test_cmd_ruok [gw0] [ 17%] PASSED test_keeper_four_word_command/test.py::test_cmd_ruok test_keeper_four_word_command/test.py::test_cmd_srst [gw0] [ 18%] PASSED test_keeper_four_word_command/test.py::test_cmd_srst test_keeper_four_word_command/test.py::test_cmd_srvr [gw0] [ 19%] PASSED test_keeper_four_word_command/test.py::test_cmd_srvr test_keeper_four_word_command/test.py::test_cmd_stat [gw0] [ 20%] PASSED test_keeper_four_word_command/test.py::test_cmd_stat test_keeper_four_word_command/test.py::test_cmd_wchc [gw0] [ 21%] PASSED test_keeper_four_word_command/test.py::test_cmd_wchc test_keeper_four_word_command/test.py::test_cmd_wchp [gw1] [ 22%] PASSED test_grant_and_revoke/test.py::test_current_database [gw0] [ 23%] PASSED test_keeper_four_word_command/test.py::test_cmd_wchp test_keeper_four_word_command/test.py::test_cmd_wchs test_grant_and_revoke/test.py::test_current_grants_override [gw0] [ 24%] PASSED test_keeper_four_word_command/test.py::test_cmd_wchs test_keeper_four_word_command/test.py::test_cmd_ydld [gw2] [ 25%] PASSED test_insert_over_http_query_log/test.py::test_insert_over_http_exception[0] test_insert_over_http_query_log/test.py::test_insert_over_http_exception[1] [gw0] [ 26%] PASSED test_keeper_four_word_command/test.py::test_cmd_ydld test_jbod_balancer/test.py::test_jbod_balanced_merge [gw1] [ 27%] PASSED test_grant_and_revoke/test.py::test_current_grants_override [gw2] [ 28%] PASSED test_insert_over_http_query_log/test.py::test_insert_over_http_exception[1] test_insert_over_http_query_log/test.py::test_insert_over_http_invalid_statement test_keeper_session/test.py::test_session_close_shutdown test_grant_and_revoke/test.py::test_grant_all_on_table [gw5] [ 29%] PASSED test_lost_part/test.py::test_lost_last_part test_lost_part/test.py::test_lost_part_mutation [gw2] [ 30%] PASSED test_insert_over_http_query_log/test.py::test_insert_over_http_invalid_statement test_insert_over_http_query_log/test.py::test_insert_over_http_ok [gw1] [ 31%] PASSED test_grant_and_revoke/test.py::test_grant_all_on_table [gw6] [ 32%] PASSED test_keeper_persistent_log/test.py::test_state_after_restart test_keeper_persistent_log/test.py::test_state_duplicate_restart test_grant_and_revoke/test.py::test_grant_current_grants [gw2] [ 33%] PASSED test_insert_over_http_query_log/test.py::test_insert_over_http_ok test_insert_over_http_query_log/test.py::test_insert_over_http_unknown_table [gw2] [ 34%] PASSED test_insert_over_http_query_log/test.py::test_insert_over_http_unknown_table [gw1] [ 35%] PASSED test_grant_and_revoke/test.py::test_grant_current_grants test_grant_and_revoke/test.py::test_grant_current_grants_with_partial_revoke [gw3] [ 36%] PASSED test_library_bridge/test.py::test_load_all test_library_bridge/test.py::test_load_all_many_rows test_drop_replica_with_auxiliary_zookeepers/test.py::test_drop_replica_in_auxiliary_zookeeper [gw1] [ 37%] PASSED test_grant_and_revoke/test.py::test_grant_current_grants_with_partial_revoke test_grant_and_revoke/test.py::test_grant_option [gw1] [ 38%] PASSED test_grant_and_revoke/test.py::test_grant_option test_grant_and_revoke/test.py::test_grant_with_replace_option [gw6] [ 39%] PASSED test_keeper_persistent_log/test.py::test_state_duplicate_restart [gw3] [ 40%] PASSED test_library_bridge/test.py::test_load_all_many_rows test_library_bridge/test.py::test_load_ids test_keeper_internal_secure/test.py::test_secure_raft_works [gw1] [ 41%] PASSED test_grant_and_revoke/test.py::test_grant_with_replace_option [gw3] [ 42%] PASSED test_library_bridge/test.py::test_load_ids test_library_bridge/test.py::test_load_keys test_grant_and_revoke/test.py::test_implicit_create_temporary_table_grant [gw1] [ 43%] PASSED test_grant_and_revoke/test.py::test_implicit_create_temporary_table_grant [gw3] [ 44%] PASSED test_library_bridge/test.py::test_load_keys test_library_bridge/test.py::test_null_values test_grant_and_revoke/test.py::test_implicit_create_view_grant [gw3] [ 45%] PASSED test_library_bridge/test.py::test_null_values test_library_bridge/test.py::test_path_validation [gw3] [ 46%] PASSED test_library_bridge/test.py::test_path_validation test_library_bridge/test.py::test_recover_after_bridge_crash [gw1] [ 47%] PASSED test_grant_and_revoke/test.py::test_implicit_create_view_grant test_grant_and_revoke/test.py::test_implicit_show_grants [gw9] [ 48%] PASSED test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted [gw0] [ 49%] PASSED test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout [gw0] [ 50%] PASSED test_keeper_session/test.py::test_session_timeout [gw1] [ 51%] PASSED test_grant_and_revoke/test.py::test_implicit_show_grants test_grant_and_revoke/test.py::test_introspection [gw7] [ 52%] PASSED test_inserts_with_keeper_retries/test.py::test_query_timeout_with_zk_down test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_disconnect test_drop_if_empty/test.py::test_drop_if_empty [gw7] [ 53%] PASSED test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_disconnect test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_restart [gw1] [ 54%] PASSED test_grant_and_revoke/test.py::test_introspection test_grant_and_revoke/test.py::test_revoke_requires_grant_option [gw2] [ 55%] PASSED test_drop_replica_with_auxiliary_zookeepers/test.py::test_drop_replica_in_auxiliary_zookeeper [gw4] [ 56%] PASSED test_jbod_balancer/test.py::test_jbod_balanced_merge test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch [gw6] [ 57%] PASSED test_keeper_internal_secure/test.py::test_secure_raft_works test_keeper_internal_secure/test.py::test_secure_raft_works_with_password [gw1] [ 58%] PASSED test_grant_and_revoke/test.py::test_revoke_requires_grant_option test_failed_async_inserts/test.py::test_failed_async_inserts test_grant_and_revoke/test.py::test_smoke [gw3] [ 59%] PASSED test_library_bridge/test.py::test_recover_after_bridge_crash test_library_bridge/test.py::test_server_restart_bridge_might_be_still_alive [gw1] [ 60%] PASSED test_grant_and_revoke/test.py::test_smoke [gw9] [ 61%] PASSED test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error [gw9] [ 62%] SKIPPED test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error test_fix_metadata_version/test.py::test_fix_metadata_version test_insert_into_distributed_through_materialized_view/test.py::test_inserts_local [gw0] [ 63%] PASSED test_drop_if_empty/test.py::test_drop_if_empty [gw7] [ 64%] PASSED test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_restart test_freeze_table/test.py::test_freeze_table [gw1] [ 65%] PASSED test_insert_into_distributed_through_materialized_view/test.py::test_inserts_local test_group_array_element_size/test.py::test_max_exement_size [gw5] [ 66%] PASSED test_lost_part/test.py::test_lost_part_mutation test_lost_part/test.py::test_lost_part_other_replica [gw2] [ 67%] PASSED test_failed_async_inserts/test.py::test_failed_async_inserts test_keeper_availability_zone/test.py::test_get_availability_zone test_fetch_memory_usage/test.py::test_huge_column [gw9] [ 68%] PASSED test_fix_metadata_version/test.py::test_fix_metadata_version test_keeper_force_recovery_single_node/test.py::test_cluster_recovery [gw0] [ 69%] PASSED test_freeze_table/test.py::test_freeze_table [gw2] [ 70%] SKIPPED test_fetch_memory_usage/test.py::test_huge_column test_host_regexp_multiple_ptr_records_concurrent/test.py::test_host_regexp_multiple_ptr_v4 [gw1] [ 71%] PASSED test_keeper_availability_zone/test.py::test_get_availability_zone test_keeper_mntr_data_size/test.py::test_mntr_data_size_after_restart test_keeper_and_access_storage/test.py::test_create_replicated [gw4] [ 72%] PASSED test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch [gw7] [ 73%] PASSED test_group_array_element_size/test.py::test_max_exement_size test_http_native/test.py::test_http_native_returns_timezone test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size [gw7] [ 74%] PASSED test_http_native/test.py::test_http_native_returns_timezone [gw2] [ 75%] PASSED test_keeper_and_access_storage/test.py::test_create_replicated test_keeper_s3_snapshot/test.py::test_s3_upload test_keeper_nodes_move/test.py::test_node_move [gw1] [ 76%] PASSED test_keeper_mntr_data_size/test.py::test_mntr_data_size_after_restart test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 [gw6] [ 77%] PASSED test_keeper_internal_secure/test.py::test_secure_raft_works_with_password test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts [gw3] [ 78%] PASSED test_library_bridge/test.py::test_server_restart_bridge_might_be_still_alive test_library_bridge/test.py::test_ssrf [gw3] [ 79%] SKIPPED test_library_bridge/test.py::test_ssrf [gw9] [ 80%] PASSED test_keeper_force_recovery_single_node/test.py::test_cluster_recovery test_keeper_force_recovery/test.py::test_cluster_recovery test_keeper_four_word_command/test_allow_list.py::test_allow_list [gw6] [ 81%] PASSED test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts [gw4] [ 82%] PASSED test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size test_memory_limit_observer/test.py::test_observe_memory_limit [gw4] [ 83%] PASSED test_memory_limit_observer/test.py::test_observe_memory_limit test_jbod_ha/test.py::test_jbod_ha [gw9] [ 84%] PASSED test_keeper_four_word_command/test_allow_list.py::test_allow_list test_keeper_secure_client/test.py::test_connection [gw7] [ 85%] PASSED test_keeper_nodes_move/test.py::test_node_move [gw9] [ 86%] PASSED test_keeper_secure_client/test.py::test_connection [gw6] [ 87%] PASSED test_jbod_ha/test.py::test_jbod_ha [gw0] [ 88%] PASSED test_host_regexp_multiple_ptr_records_concurrent/test.py::test_host_regexp_multiple_ptr_v4 [gw3] [ 89%] PASSED test_keeper_force_recovery/test.py::test_cluster_recovery test_keeper_mntr_pressure/test.py::test_aggressive_mntr [gw8] [ 90%] ERROR test_log_family_s3/test.py::test_log_family_s3[Log] test_log_family_s3/test.py::test_log_family_s3[StripeLog] [gw8] [ 91%] ERROR test_log_family_s3/test.py::test_log_family_s3[StripeLog] test_log_family_s3/test.py::test_log_family_s3[TinyLog] [gw8] [ 92%] ERROR test_log_family_s3/test.py::test_log_family_s3[TinyLog] [gw0] [ 93%] PASSED test_keeper_mntr_pressure/test.py::test_aggressive_mntr test_library_bridge/test_exiled.py::test_bridge_dies_with_parent [gw0] [ 94%] SKIPPED test_library_bridge/test_exiled.py::test_bridge_dies_with_parent [gw2] [ 95%] ERROR test_keeper_s3_snapshot/test.py::test_s3_upload [gw5] [ 96%] PASSED test_lost_part/test.py::test_lost_part_other_replica test_lost_part/test.py::test_lost_part_same_replica [gw5] [ 97%] PASSED test_lost_part/test.py::test_lost_part_same_replica test_keeper_reconfig_add/test.py::test_reconfig_add [gw1] [ 98%] ERROR test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 test_max_rows_to_read_leaf_with_view/test.py::test_max_rows_to_read_leaf_via_view [gw1] [ 99%] PASSED test_max_rows_to_read_leaf_with_view/test.py::test_max_rows_to_read_leaf_via_view [gw5] [100%] PASSED test_keeper_reconfig_add/test.py::test_reconfig_add ==================================== ERRORS ==================================== __________________ ERROR at setup of test_log_family_s3[Log] ___________________ [gw8] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=["configs/minio.xml", "configs/ssl.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_log_family_s3/test.py:18: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2699, in start raise ex File "/ClickHouse/tests/integration/helpers/cluster.py", line 2695, in start run_and_check(images_pull_cmd) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-10-26 12:13:40 [ 510 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:13:40 [ 510 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:13:40 [ 510 ] DEBUG : No running containers (conftest.py:92, cleanup_environment) 2026-10-26 12:13:40 [ 510 ] DEBUG : Pruning Docker networks (conftest.py:94, cleanup_environment) 2026-10-26 12:13:40 [ 510 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-10-26 12:13:40 [ 510 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-10-26 12:13:40 [ 510 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV HOSTNAME 52cbb9a4e681 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV SHLVL 0 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV HOME /root (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV OLDPWD / (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG a2d3dc777d0c (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_drop_if_empty/test.py::test_drop_if_empty test_drop_replica_with_auxiliary_zookeepers/test.py::test_drop_replica_in_auxiliary_zookeeper test_failed_async_inserts/test.py::test_failed_async_inserts test_fetch_memory_usage/test.py::test_huge_column test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts test_fix_metadata_version/test.py::test_fix_metadata_version test_freeze_table/test.py::test_freeze_table test_grant_and_revoke/test.py::test_allowed_grantees test_grant_and_revoke/test.py::test_current_database test_grant_and_revoke/test.py::test_current_grants_override test_grant_and_revoke/test.py::test_grant_all_on_table test_grant_and_revoke/test.py::test_grant_current_grants test_grant_and_revoke/test.py::test_grant_current_grants_with_partial_revoke test_grant_and_revoke/test.py::test_grant_option test_grant_and_revoke/test.py::test_grant_with_replace_option test_grant_and_revoke/test.py::test_implicit_create_temporary_table_grant test_grant_and_revoke/test.py::test_implicit_create_view_grant test_grant_and_revoke/test.py::test_implicit_show_grants test_grant_and_revoke/test.py::test_introspection test_grant_and_revoke/test.py::test_revoke_requires_grant_option test_grant_and_revoke/test.py::test_smoke test_group_array_element_size/test.py::test_max_exement_size test_host_regexp_multiple_ptr_records_concurrent/test.py::test_host_regexp_multiple_ptr_v4 test_http_native/test.py::test_http_native_returns_timezone test_insert_into_distributed_through_materialized_view/test.py::test_inserts_local 'test_insert_over_http_query_log/test.py::test_insert_over_http_exception[0]' 'test_insert_over_http_query_log/test.py::test_insert_over_http_exception[1]' test_insert_over_http_query_log/test.py::test_insert_over_http_invalid_statement test_insert_over_http_query_log/test.py::test_insert_over_http_ok test_insert_over_http_query_log/test.py::test_insert_over_http_unknown_table test_inserts_with_keeper_retries/test.py::test_query_timeout_with_zk_down test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_disconnect test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_restart test_jbod_balancer/test.py::test_jbod_balanced_merge test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch test_jbod_ha/test.py::test_jbod_ha test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin test_keeper_and_access_storage/test.py::test_create_replicated test_keeper_availability_zone/test.py::test_get_availability_zone test_keeper_force_recovery/test.py::test_cluster_recovery test_keeper_force_recovery_single_node/test.py::test_cluster_recovery test_keeper_four_word_command/test.py::test_cmd_clrs test_keeper_four_word_command/test.py::test_cmd_conf test_keeper_four_word_command/test.py::test_cmd_cons test_keeper_four_word_command/test.py::test_cmd_crst test_keeper_four_word_command/test.py::test_cmd_csnp test_keeper_four_word_command/test.py::test_cmd_dump test_keeper_four_word_command/test.py::test_cmd_isro test_keeper_four_word_command/test.py::test_cmd_lgif test_keeper_four_word_command/test.py::test_cmd_mntr test_keeper_four_word_command/test.py::test_cmd_rqld test_keeper_four_word_command/test.py::test_cmd_ruok test_keeper_four_word_command/test.py::test_cmd_srst test_keeper_four_word_command/test.py::test_cmd_srvr test_keeper_four_word_command/test.py::test_cmd_stat test_keeper_four_word_command/test.py::test_cmd_wchc test_keeper_four_word_command/test.py::test_cmd_wchp test_keeper_four_word_command/test.py::test_cmd_wchs test_keeper_four_word_command/test.py::test_cmd_ydld test_keeper_four_word_command/test_allow_list.py::test_allow_list test_keeper_internal_secure/test.py::test_secure_raft_works test_keeper_internal_secure/test.py::test_secure_raft_works_with_password test_keeper_mntr_data_size/test.py::test_mntr_data_size_after_restart test_keeper_mntr_pressure/test.py::test_aggressive_mntr test_keeper_nodes_move/test.py::test_node_move test_keeper_persistent_log/test.py::test_ephemeral_after_restart test_keeper_persistent_log/test.py::test_state_after_restart test_keeper_persistent_log/test.py::test_state_duplicate_restart test_keeper_reconfig_add/test.py::test_reconfig_add test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 test_keeper_s3_snapshot/test.py::test_s3_upload test_keeper_secure_client/test.py::test_connection test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout test_library_bridge/test.py::test_load_all test_library_bridge/test.py::test_load_all_many_rows test_library_bridge/test.py::test_load_ids test_library_bridge/test.py::test_load_keys test_library_bridge/test.py::test_null_values test_library_bridge/test.py::test_path_validation test_library_bridge/test.py::test_recover_after_bridge_crash test_library_bridge/test.py::test_server_restart_bridge_might_be_still_alive test_library_bridge/test.py::test_ssrf test_library_bridge/test_exiled.py::test_bridge_dies_with_parent 'test_log_family_s3/test.py::test_log_family_s3[Log]' 'test_log_family_s3/test.py::test_log_family_s3[StripeLog]' 'test_log_family_s3/test.py::test_log_family_s3[TinyLog]' test_lost_part/test.py::test_lost_last_part test_lost_part/test.py::test_lost_part_mutation test_lost_part/test.py::test_lost_part_other_replica test_lost_part/test.py::test_lost_part_same_replica test_max_rows_to_read_leaf_with_view/test.py::test_max_rows_to_read_leaf_via_view test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size test_memory_limit_observer/test.py::test_observe_memory_limit test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error -vvv (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG ce74919e88f5 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV TZ Etc/UTC (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV DOCKER_BASE_TAG 2993bc2bf171 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID 064e7358534246ed8f8bcb9da01756c4 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV PYTEST_XDIST_WORKER gw8 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : ENV PYTEST_CURRENT_TEST test_log_family_s3/test.py::test_log_family_s3[Log] (setup) (cluster.py:400, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:696, __init__) 2026-10-26 12:13:40 [ 510 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:13:40 [ 510 ] DEBUG : Cluster name: project_name:roottestlogfamilys3. Added instance name:node tag:2993bc2bf171 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:13:40 [ 510 ] INFO : Starting cluster... (test.py:17, cluster) 2026-10-26 12:13:40 [ 510 ] INFO : Running tests in /ClickHouse/tests/integration/test_log_family_s3/test.py (cluster.py:2659, start) 2026-10-26 12:13:40 [ 510 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 12:13:40 [ 510 ] DEBUG : Docker networks for project roottestlogfamilys3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:13:40 [ 510 ] DEBUG : Docker containers for project roottestlogfamilys3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:13:40 [ 510 ] DEBUG : Docker volumes for project roottestlogfamilys3 are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:13:40 [ 510 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:13:40 [ 510 ] DEBUG : Docker networks for project roottestlogfamilys3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:13:40 [ 510 ] DEBUG : Docker containers for project roottestlogfamilys3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:13:40 [ 510 ] DEBUG : Docker volumes for project roottestlogfamilys3 are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:13:40 [ 510 ] DEBUG : Command:docker container list --all --filter name='^/roottestlogfamilys3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:13:40 [ 510 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:13:40 [ 510 ] DEBUG : No running containers for project: roottestlogfamilys3 (cluster.py:829, cleanup) 2026-10-26 12:13:40 [ 510 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:13:40 [ 510 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:13:40 [ 510 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:13:40 [ 510 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:13:40 [ 510 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:13:40 [ 510 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:13:40 [ 510 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:13:40 [ 510 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:13:40 [ 510 ] DEBUG : Setup directory for instance: node (cluster.py:2679, start) 2026-10-26 12:13:40 [ 510 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:13:40 [ 510 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:13:40 [ 510 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:13:40 [ 510 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:13:40 [ 510 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_log_family_s3/configs/minio.xml', '/ClickHouse/tests/integration/test_log_family_s3/configs/ssl.xml'] to /ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:13:40 [ 510 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/database (cluster.py:4488, create_dir) 2026-10-26 12:13:40 [ 510 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/logs (cluster.py:4499, create_dir) 2026-10-26 12:13:40 [ 510 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:13:40 [ 510 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env (cluster.py:86, _create_env_file) 2026-10-26 12:13:40 [ 510 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:13:40 [ 510 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:13:40 [ 510 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:13:40 [ 510 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:13:40 [ 510 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 12:13:40 [ 510 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:14:34 [ 510 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:14:34 [ 510 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling resolver ... Pulling node ... Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:14:34 [ 510 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:15:28 [ 510 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:15:28 [ 510 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:15:31 [ 510 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:16:15 [ 510 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:16:15 [ 510 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling resolver ... Pulling node ... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:16:21 [ 510 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:17:08 [ 510 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:17:08 [ 510 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling resolver ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:17:17 [ 510 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Failed to start cluster: (cluster.py:3030, start) 2026-10-26 12:18:01 [ 510 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3031, start) 2026-10-26 12:18:01 [ 510 ] DEBUG : None (cluster.py:3032, start) 2026-10-26 12:18:01 [ 510 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:18:01 [ 510 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:18:01 [ 510 ] DEBUG : Docker networks for project roottestlogfamilys3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:18:01 [ 510 ] DEBUG : Docker containers for project roottestlogfamilys3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:18:01 [ 510 ] DEBUG : Docker volumes for project roottestlogfamilys3 are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:18:01 [ 510 ] DEBUG : Command:docker container list --all --filter name='^/roottestlogfamilys3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:18:01 [ 510 ] DEBUG : No running containers for project: roottestlogfamilys3 (cluster.py:829, cleanup) 2026-10-26 12:18:01 [ 510 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:18:01 [ 510 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:18:01 [ 510 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:18:01 [ 510 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:18:01 [ 510 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:18:01 [ 510 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:18:01 [ 510 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:18:01 [ 510 ] DEBUG : Docker networks for project roottestlogfamilys3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:18:01 [ 510 ] DEBUG : Docker containers for project roottestlogfamilys3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:18:01 [ 510 ] DEBUG : Docker volumes for project roottestlogfamilys3 are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:18:01 [ 510 ] DEBUG : Command:docker container list --all --filter name='^/roottestlogfamilys3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:18:01 [ 510 ] DEBUG : No running containers for project: roottestlogfamilys3 (cluster.py:829, cleanup) 2026-10-26 12:18:01 [ 510 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:18:01 [ 510 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:18:01 [ 510 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:18:01 [ 510 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:18:01 [ 510 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:18:01 [ 510 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) _______________ ERROR at setup of test_log_family_s3[StripeLog] ________________ [gw8] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=["configs/minio.xml", "configs/ssl.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_log_family_s3/test.py:18: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________ ERROR at setup of test_log_family_s3[TinyLog] _________________ [gw8] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=["configs/minio.xml", "configs/ssl.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_log_family_s3/test.py:18: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______________________ ERROR at setup of test_s3_upload _______________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: > cluster.start() test_keeper_s3_snapshot/test.py:37: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/.env', '--project-name', 'roottestkeepers3snapshot', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/.env', '--project-name', 'roottestkeepers3snapshot', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node3 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling node3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling node3 ... status: image is up to date for a... E Pulling node3 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling node2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2699, in start raise ex File "/ClickHouse/tests/integration/helpers/cluster.py", line 2695, in start run_and_check(images_pull_cmd) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/.env', '--project-name', 'roottestkeepers3snapshot', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node3 ... Pulling node1 ... Pulling node2 ... Pulling resolver ... Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling node3 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-10-26 12:15:51 [ 492 ] INFO : Running tests in /ClickHouse/tests/integration/test_keeper_s3_snapshot/test.py (cluster.py:2659, start) 2026-10-26 12:15:51 [ 492 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 12:15:51 [ 492 ] DEBUG : Docker networks for project roottestkeepers3snapshot are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:15:51 [ 492 ] DEBUG : Docker containers for project roottestkeepers3snapshot are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:15:51 [ 492 ] DEBUG : Docker volumes for project roottestkeepers3snapshot are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:15:51 [ 492 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:15:51 [ 492 ] DEBUG : Docker networks for project roottestkeepers3snapshot are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:15:51 [ 492 ] DEBUG : Docker containers for project roottestkeepers3snapshot are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:15:51 [ 492 ] DEBUG : Docker volumes for project roottestkeepers3snapshot are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:15:51 [ 492 ] DEBUG : Command:docker container list --all --filter name='^/roottestkeepers3snapshot_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:15:51 [ 492 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:15:51 [ 492 ] DEBUG : No running containers for project: roottestkeepers3snapshot (cluster.py:829, cleanup) 2026-10-26 12:15:51 [ 492 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:15:51 [ 492 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:15:51 [ 492 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:15:51 [ 492 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:15:51 [ 492 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:15:51 [ 492 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:15:51 [ 492 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:15:51 [ 492 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:15:51 [ 492 ] DEBUG : Setup directory for instance: node1 (cluster.py:2679, start) 2026-10-26 12:15:51 [ 492 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_s3_snapshot/configs/keeper_config1.xml'] to /ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node1/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node1/database (cluster.py:4488, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node1/logs (cluster.py:4499, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4582, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Setup directory for instance: node2 (cluster.py:2679, start) 2026-10-26 12:15:51 [ 492 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_s3_snapshot/configs/keeper_config2.xml'] to /ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node2/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node2/database (cluster.py:4488, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node2/logs (cluster.py:4499, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4582, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Setup directory for instance: node3 (cluster.py:2679, start) 2026-10-26 12:15:51 [ 492 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_s3_snapshot/configs/keeper_config3.xml'] to /ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node3/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node3/database (cluster.py:4488, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node3/logs (cluster.py:4499, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4582, create_dir) 2026-10-26 12:15:51 [ 492 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/.env (cluster.py:86, _create_env_file) 2026-10-26 12:15:51 [ 492 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:15:51 [ 492 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:15:51 [ 492 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:15:51 [ 492 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:15:51 [ 492 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 12:15:51 [ 492 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/.env', '--project-name', 'roottestkeepers3snapshot', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:15:53 [ 492 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:16:00 [ 492 ] INFO : Connecting to 172.16.12.4(172.16.12.4):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:16:10 [ 492 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:16:25 [ 492 ] INFO : Connecting to 172.16.12.4(172.16.12.4):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:16:35 [ 492 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:16:36 [ 492 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:16:36 [ 492 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/.env', '--project-name', 'roottestkeepers3snapshot', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling resolver ... Pulling node3 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... done Pulling node3 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:16:36 [ 492 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/.env', '--project-name', 'roottestkeepers3snapshot', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:17:15 [ 492 ] INFO : Connecting to 172.16.12.4(172.16.12.4):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:17:25 [ 492 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:17:29 [ 492 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:17:29 [ 492 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/.env', '--project-name', 'roottestkeepers3snapshot', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node3 ... Pulling node1 ... Pulling node2 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling node3 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:17:32 [ 492 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/.env', '--project-name', 'roottestkeepers3snapshot', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:18:22 [ 492 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:18:22 [ 492 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/.env', '--project-name', 'roottestkeepers3snapshot', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node3 ... Pulling node2 ... Pulling node1 ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling node3 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node3 ... status: image is up to date for a... Pulling node2 ... status: image is up to date for a... Pulling node3 ... done Pulling node2 ... done Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:18:28 [ 492 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/.env', '--project-name', 'roottestkeepers3snapshot', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:18:41 [ 492 ] INFO : Connecting to 172.16.12.4(172.16.12.4):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:18:51 [ 492 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:19:14 [ 492 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:19:14 [ 492 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/.env', '--project-name', 'roottestkeepers3snapshot', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling node3 ... Pulling resolver ... Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node3 ... pulling from altinityinfra/integr... Pulling node1 ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node2 ... done Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:19:24 [ 492 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/.env', '--project-name', 'roottestkeepers3snapshot', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Failed to start cluster: (cluster.py:3030, start) 2026-10-26 12:20:07 [ 492 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/.env', '--project-name', 'roottestkeepers3snapshot', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node3 ... Pulling node1 ... Pulling node2 ... Pulling resolver ... Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling node3 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3031, start) 2026-10-26 12:20:07 [ 492 ] DEBUG : None (cluster.py:3032, start) 2026-10-26 12:20:07 [ 492 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:20:07 [ 492 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:20:07 [ 492 ] DEBUG : Docker networks for project roottestkeepers3snapshot are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:20:07 [ 492 ] DEBUG : Docker containers for project roottestkeepers3snapshot are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:20:07 [ 492 ] DEBUG : Docker volumes for project roottestkeepers3snapshot are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:20:07 [ 492 ] DEBUG : Command:docker container list --all --filter name='^/roottestkeepers3snapshot_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:20:07 [ 492 ] DEBUG : No running containers for project: roottestkeepers3snapshot (cluster.py:829, cleanup) 2026-10-26 12:20:07 [ 492 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:20:07 [ 492 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:20:07 [ 492 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:20:07 [ 492 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:20:07 [ 492 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:20:07 [ 492 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:20:07 [ 492 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:20:07 [ 492 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:20:07 [ 492 ] DEBUG : Docker networks for project roottestkeepers3snapshot are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:20:08 [ 492 ] DEBUG : Docker containers for project roottestkeepers3snapshot are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:20:08 [ 492 ] DEBUG : Docker volumes for project roottestkeepers3snapshot are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:20:08 [ 492 ] DEBUG : Command:docker container list --all --filter name='^/roottestkeepers3snapshot_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:20:08 [ 492 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:20:08 [ 492 ] DEBUG : No running containers for project: roottestkeepers3snapshot (cluster.py:829, cleanup) 2026-10-26 12:20:08 [ 492 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:20:08 [ 492 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:20:08 [ 492 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:20:08 [ 492 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:20:08 [ 492 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:20:08 [ 492 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:20:08 [ 492 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:20:08 [ 492 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) __________ ERROR at setup of test_recover_from_snapshot_with_disk_s3 ___________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: > cluster.start() test_keeper_restore_from_snapshot/test_disk_s3.py:48: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/.env', '--project-name', 'roottestkeeperrestorefromsnapshotdisks3', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/.env', '--project-name', 'roottestkeeperrestorefromsnapshotdisks3', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node3 ... E Pulling node2 ... E Pulling node1 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node1 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling node1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling node1 ... done E Pulling resolver ... done E Pulling node3 ... pulling from altinityinfra/integr... E Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling node3 ... status: image is up to date for a... E Pulling node3 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2699, in start raise ex File "/ClickHouse/tests/integration/helpers/cluster.py", line 2695, in start run_and_check(images_pull_cmd) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/.env', '--project-name', 'roottestkeeperrestorefromsnapshotdisks3', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node3 ... Pulling node2 ... Pulling node1 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling node1 ... done Pulling resolver ... done Pulling node3 ... pulling from altinityinfra/integr... Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-10-26 12:15:56 [ 489 ] INFO : Running tests in /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/test_disk_s3.py (cluster.py:2659, start) 2026-10-26 12:15:56 [ 489 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 12:15:56 [ 489 ] DEBUG : Docker networks for project roottestkeeperrestorefromsnapshotdisks3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:15:56 [ 489 ] DEBUG : Docker containers for project roottestkeeperrestorefromsnapshotdisks3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:15:56 [ 489 ] DEBUG : Docker volumes for project roottestkeeperrestorefromsnapshotdisks3 are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:15:56 [ 489 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:15:56 [ 489 ] DEBUG : Docker networks for project roottestkeeperrestorefromsnapshotdisks3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:15:56 [ 489 ] DEBUG : Docker containers for project roottestkeeperrestorefromsnapshotdisks3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:15:56 [ 489 ] DEBUG : Docker volumes for project roottestkeeperrestorefromsnapshotdisks3 are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:15:56 [ 489 ] DEBUG : Command:docker container list --all --filter name='^/roottestkeeperrestorefromsnapshotdisks3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:15:56 [ 489 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:15:56 [ 489 ] DEBUG : No running containers for project: roottestkeeperrestorefromsnapshotdisks3 (cluster.py:829, cleanup) 2026-10-26 12:15:56 [ 489 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:15:56 [ 489 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:15:56 [ 489 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:15:56 [ 489 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:15:56 [ 489 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:15:56 [ 489 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:15:56 [ 489 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:15:57 [ 489 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:15:57 [ 489 ] DEBUG : Setup directory for instance: node1 (cluster.py:2679, start) 2026-10-26 12:15:57 [ 489 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/configs/enable_keeper1.xml', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/configs/disk_s3_storage.xml', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/configs/keeper1_snapshot_disk.xml'] to /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node1/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node1/database (cluster.py:4488, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node1/logs (cluster.py:4499, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4582, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Setup directory for instance: node2 (cluster.py:2679, start) 2026-10-26 12:15:57 [ 489 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/configs/enable_keeper2.xml', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/configs/disk_s3_storage.xml', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/configs/keeper2_snapshot_disk.xml'] to /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node2/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node2/database (cluster.py:4488, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node2/logs (cluster.py:4499, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4582, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Setup directory for instance: node3 (cluster.py:2679, start) 2026-10-26 12:15:57 [ 489 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/configs/enable_keeper3.xml', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/configs/disk_s3_storage.xml', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/configs/keeper3_snapshot_disk.xml'] to /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node3/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node3/database (cluster.py:4488, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node3/logs (cluster.py:4499, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4582, create_dir) 2026-10-26 12:15:57 [ 489 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/.env (cluster.py:86, _create_env_file) 2026-10-26 12:15:57 [ 489 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:15:57 [ 489 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:15:57 [ 489 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:15:57 [ 489 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:15:57 [ 489 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 12:15:57 [ 489 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/.env', '--project-name', 'roottestkeeperrestorefromsnapshotdisks3', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:16:57 [ 489 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:16:57 [ 489 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/.env', '--project-name', 'roottestkeeperrestorefromsnapshotdisks3', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node2 ... Pulling node3 ... Pulling node1 ... Pulling resolver ... Pulling node3 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:16:57 [ 489 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/.env', '--project-name', 'roottestkeeperrestorefromsnapshotdisks3', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:17:50 [ 489 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:17:50 [ 489 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/.env', '--project-name', 'roottestkeeperrestorefromsnapshotdisks3', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node3 ... Pulling node2 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node3 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:17:53 [ 489 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/.env', '--project-name', 'roottestkeeperrestorefromsnapshotdisks3', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:18:43 [ 489 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:18:43 [ 489 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/.env', '--project-name', 'roottestkeeperrestorefromsnapshotdisks3', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node3 ... Pulling node2 ... Pulling node1 ... Pulling resolver ... Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node3 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... Pulling node3 ... status: image is up to date for a... Pulling node2 ... done Pulling node3 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:18:49 [ 489 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/.env', '--project-name', 'roottestkeeperrestorefromsnapshotdisks3', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:19:36 [ 489 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:19:36 [ 489 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/.env', '--project-name', 'roottestkeeperrestorefromsnapshotdisks3', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node3 ... Pulling node2 ... Pulling node1 ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node1 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node2 ... done Pulling node3 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:19:45 [ 489 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/.env', '--project-name', 'roottestkeeperrestorefromsnapshotdisks3', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Failed to start cluster: (cluster.py:3030, start) 2026-10-26 12:20:28 [ 489 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/.env', '--project-name', 'roottestkeeperrestorefromsnapshotdisks3', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_disk_s3_0/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node3 ... Pulling node2 ... Pulling node1 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling node1 ... done Pulling resolver ... done Pulling node3 ... pulling from altinityinfra/integr... Pulling node3 ... digest: sha256:8a2c68e2d63d82c826... Pulling node3 ... status: image is up to date for a... Pulling node3 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3031, start) 2026-10-26 12:20:28 [ 489 ] DEBUG : None (cluster.py:3032, start) 2026-10-26 12:20:28 [ 489 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:20:28 [ 489 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:20:28 [ 489 ] DEBUG : Docker networks for project roottestkeeperrestorefromsnapshotdisks3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:20:28 [ 489 ] DEBUG : Docker containers for project roottestkeeperrestorefromsnapshotdisks3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:20:28 [ 489 ] DEBUG : Docker volumes for project roottestkeeperrestorefromsnapshotdisks3 are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:20:28 [ 489 ] DEBUG : Command:docker container list --all --filter name='^/roottestkeeperrestorefromsnapshotdisks3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:20:28 [ 489 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:20:28 [ 489 ] DEBUG : No running containers for project: roottestkeeperrestorefromsnapshotdisks3 (cluster.py:829, cleanup) 2026-10-26 12:20:28 [ 489 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:20:28 [ 489 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:20:28 [ 489 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:20:29 [ 489 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:20:29 [ 489 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:20:29 [ 489 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:20:29 [ 489 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:20:29 [ 489 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:20:29 [ 489 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:20:29 [ 489 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:20:29 [ 489 ] DEBUG : Docker networks for project roottestkeeperrestorefromsnapshotdisks3 are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:20:29 [ 489 ] DEBUG : Docker containers for project roottestkeeperrestorefromsnapshotdisks3 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:20:29 [ 489 ] DEBUG : Docker volumes for project roottestkeeperrestorefromsnapshotdisks3 are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:20:29 [ 489 ] DEBUG : Command:docker container list --all --filter name='^/roottestkeeperrestorefromsnapshotdisks3_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:20:29 [ 489 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:20:29 [ 489 ] DEBUG : No running containers for project: roottestkeeperrestorefromsnapshotdisks3 (cluster.py:829, cleanup) 2026-10-26 12:20:29 [ 489 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:20:29 [ 489 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:20:29 [ 489 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:20:29 [ 489 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:20:29 [ 489 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:20:29 [ 489 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:20:29 [ 489 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:20:29 [ 489 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) =============================== warnings summary =============================== test_keeper_mntr_pressure/test.py::test_aggressive_mntr /usr/local/lib/python3.10/dist-packages/_pytest/threadexception.py:73: PytestUnhandledThreadExceptionWarning: Exception in thread Thread-89 () Traceback (most recent call last): File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner self.run() File "/usr/lib/python3.10/threading.py", line 953, in run self._target(*self._args, **self._kwargs) File "/ClickHouse/tests/integration/test_keeper_mntr_pressure/test.py", line 54, in node1_thread = threading.Thread(target=lambda: go_mntr(node1)) File "/ClickHouse/tests/integration/test_keeper_mntr_pressure/test.py", line 50, in go_mntr print(node.name, keeper_utils.send_4lw_cmd(cluster, node, "mntr")) File "/ClickHouse/tests/integration/helpers/keeper_utils.py", line 232, in send_4lw_cmd data = client.recv(100_000) ConnectionResetError: [Errno 104] Connection reset by peer warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg)) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ============================== slowest durations =============================== 306.56s call test_lost_part/test.py::test_lost_part_other_replica 272.52s setup test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 261.01s setup test_log_family_s3/test.py::test_log_family_s3[Log] 256.57s setup test_keeper_s3_snapshot/test.py::test_s3_upload 109.19s call test_host_regexp_multiple_ptr_records_concurrent/test.py::test_host_regexp_multiple_ptr_v4 83.03s call test_library_bridge/test.py::test_server_restart_bridge_might_be_still_alive 72.16s call test_keeper_internal_secure/test.py::test_secure_raft_works_with_password 60.87s call test_lost_part/test.py::test_lost_part_mutation 58.00s call test_keeper_force_recovery/test.py::test_cluster_recovery 54.22s call test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch 45.87s call test_keeper_mntr_pressure/test.py::test_aggressive_mntr 41.72s call test_keeper_nodes_move/test.py::test_node_move 37.00s call test_keeper_force_recovery_single_node/test.py::test_cluster_recovery 33.26s call test_jbod_ha/test.py::test_jbod_ha 32.31s call test_inserts_with_keeper_retries/test.py::test_query_timeout_with_zk_down 29.70s setup test_merge_tree_load_parts/test.py::test_merge_tree_load_parts 27.00s setup test_keeper_force_recovery/test.py::test_cluster_recovery 25.15s call test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_restart 23.81s setup test_max_rows_to_read_leaf_with_view/test.py::test_max_rows_to_read_leaf_via_view 23.04s setup test_jbod_balancer/test.py::test_jbod_balanced_merge 22.58s call test_library_bridge/test.py::test_recover_after_bridge_crash 22.05s call test_merge_tree_load_parts/test.py::test_merge_tree_load_parts 22.03s setup test_inserts_with_keeper_retries/test.py::test_query_timeout_with_zk_down 21.86s setup test_keeper_reconfig_add/test.py::test_reconfig_add 21.64s setup test_lost_part/test.py::test_lost_last_part 21.64s call test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size 20.78s setup test_failed_async_inserts/test.py::test_failed_async_inserts 19.89s setup test_insert_over_http_query_log/test.py::test_insert_over_http_exception[0] 19.68s setup test_drop_replica_with_auxiliary_zookeepers/test.py::test_drop_replica_in_auxiliary_zookeeper 19.55s setup test_host_regexp_multiple_ptr_records_concurrent/test.py::test_host_regexp_multiple_ptr_v4 19.37s call test_group_array_element_size/test.py::test_max_exement_size 19.30s setup test_drop_if_empty/test.py::test_drop_if_empty 17.86s call test_jbod_balancer/test.py::test_jbod_balanced_merge 17.76s setup test_library_bridge/test.py::test_load_all 17.65s call test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted 16.99s setup test_keeper_availability_zone/test.py::test_get_availability_zone 16.45s setup test_keeper_four_word_command/test.py::test_cmd_clrs 16.06s call test_keeper_internal_secure/test.py::test_secure_raft_works 16.02s setup test_keeper_secure_client/test.py::test_connection 15.80s setup test_keeper_force_recovery_single_node/test.py::test_cluster_recovery 15.66s setup test_keeper_and_access_storage/test.py::test_create_replicated 15.17s setup test_keeper_persistent_log/test.py::test_ephemeral_after_restart 14.75s setup test_grant_and_revoke/test.py::test_allowed_grantees 14.66s setup test_keeper_mntr_pressure/test.py::test_aggressive_mntr 14.59s setup test_fix_metadata_version/test.py::test_fix_metadata_version 14.45s setup test_freeze_table/test.py::test_freeze_table 14.33s setup test_keeper_mntr_data_size/test.py::test_mntr_data_size_after_restart 14.32s setup test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used 14.24s setup test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size 14.06s setup test_jbod_ha/test.py::test_jbod_ha 13.92s teardown test_keeper_reconfig_add/test.py::test_reconfig_add 13.90s call test_keeper_session/test.py::test_session_close_shutdown 13.87s setup test_keeper_session/test.py::test_session_close_shutdown 13.55s setup test_group_array_element_size/test.py::test_max_exement_size 13.16s setup test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts 13.11s setup test_keeper_four_word_command/test_allow_list.py::test_allow_list 12.67s call test_library_bridge/test.py::test_load_all 12.66s teardown test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts 12.28s call test_keeper_persistent_log/test.py::test_state_duplicate_restart 11.42s setup test_insert_into_distributed_through_materialized_view/test.py::test_inserts_local 10.59s call test_memory_limit_observer/test.py::test_observe_memory_limit 10.24s setup test_fetch_memory_usage/test.py::test_huge_column 10.10s call test_drop_replica_with_auxiliary_zookeepers/test.py::test_drop_replica_in_auxiliary_zookeeper 10.02s teardown test_max_rows_to_read_leaf_with_view/test.py::test_max_rows_to_read_leaf_via_view 9.70s call test_keeper_reconfig_add/test.py::test_reconfig_add 9.60s call test_library_bridge/test.py::test_load_all_many_rows 9.23s call test_fix_metadata_version/test.py::test_fix_metadata_version 8.95s setup test_keeper_internal_secure/test.py::test_secure_raft_works 7.96s call test_lost_part/test.py::test_lost_part_same_replica 7.42s teardown test_host_regexp_multiple_ptr_records_concurrent/test.py::test_host_regexp_multiple_ptr_v4 7.30s call test_grant_and_revoke/test.py::test_implicit_show_grants 7.28s setup test_keeper_nodes_move/test.py::test_node_move 7.14s call test_grant_and_revoke/test.py::test_revoke_requires_grant_option 7.04s call test_keeper_mntr_data_size/test.py::test_mntr_data_size_after_restart 6.47s call test_keeper_persistent_log/test.py::test_state_after_restart 6.43s setup test_library_bridge/test_exiled.py::test_bridge_dies_with_parent 6.42s teardown test_fetch_memory_usage/test.py::test_huge_column 6.02s teardown test_lost_part/test.py::test_lost_part_same_replica 5.84s call test_grant_and_revoke/test.py::test_introspection 5.52s teardown test_drop_if_empty/test.py::test_drop_if_empty 5.43s teardown test_grant_and_revoke/test.py::test_smoke 5.41s teardown test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_restart 5.38s call test_drop_if_empty/test.py::test_drop_if_empty 5.34s call test_keeper_persistent_log/test.py::test_ephemeral_after_restart 5.22s teardown test_failed_async_inserts/test.py::test_failed_async_inserts 4.94s call test_grant_and_revoke/test.py::test_grant_current_grants_with_partial_revoke 4.93s teardown test_insert_over_http_query_log/test.py::test_insert_over_http_unknown_table 4.93s setup test_http_native/test.py::test_http_native_returns_timezone 4.92s call test_grant_and_revoke/test.py::test_allowed_grantees 4.90s teardown test_keeper_secure_client/test.py::test_connection 4.82s teardown test_insert_into_distributed_through_materialized_view/test.py::test_inserts_local 4.78s teardown test_memory_limit_observer/test.py::test_observe_memory_limit 4.57s call test_lost_part/test.py::test_lost_last_part 4.53s teardown test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin 4.41s teardown test_keeper_force_recovery/test.py::test_cluster_recovery 4.40s teardown test_http_native/test.py::test_http_native_returns_timezone 4.38s teardown test_freeze_table/test.py::test_freeze_table 4.28s teardown test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 4.19s call test_grant_and_revoke/test.py::test_grant_with_replace_option 4.16s teardown test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch 3.95s teardown test_keeper_internal_secure/test.py::test_secure_raft_works_with_password 3.61s teardown test_fix_metadata_version/test.py::test_fix_metadata_version 3.51s teardown test_keeper_availability_zone/test.py::test_get_availability_zone 3.48s teardown test_drop_replica_with_auxiliary_zookeepers/test.py::test_drop_replica_in_auxiliary_zookeeper 3.39s call test_grant_and_revoke/test.py::test_current_grants_override 3.28s teardown test_keeper_four_word_command/test_allow_list.py::test_allow_list 3.23s teardown test_jbod_ha/test.py::test_jbod_ha 2.87s call test_insert_over_http_query_log/test.py::test_insert_over_http_exception[1] 2.85s teardown test_keeper_nodes_move/test.py::test_node_move 2.84s teardown test_keeper_mntr_pressure/test.py::test_aggressive_mntr 2.75s call test_insert_over_http_query_log/test.py::test_insert_over_http_exception[0] 2.74s teardown test_keeper_session/test.py::test_session_timeout 2.69s teardown test_keeper_force_recovery_single_node/test.py::test_cluster_recovery 2.57s teardown test_library_bridge/test.py::test_ssrf 2.57s call test_grant_and_revoke/test.py::test_implicit_create_view_grant 2.51s call test_grant_and_revoke/test.py::test_grant_current_grants 2.48s teardown test_keeper_four_word_command/test.py::test_cmd_ydld 2.33s teardown test_keeper_persistent_log/test.py::test_state_duplicate_restart 2.25s call test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts 2.19s teardown test_group_array_element_size/test.py::test_max_exement_size 2.18s teardown test_keeper_mntr_data_size/test.py::test_mntr_data_size_after_restart 2.13s call test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_disconnect 2.12s call test_failed_async_inserts/test.py::test_failed_async_inserts 2.10s call test_insert_over_http_query_log/test.py::test_insert_over_http_ok 2.08s teardown test_keeper_and_access_storage/test.py::test_create_replicated 2.01s teardown test_library_bridge/test_exiled.py::test_bridge_dies_with_parent 1.86s call test_library_bridge/test.py::test_load_ids 1.84s call test_grant_and_revoke/test.py::test_grant_option 1.78s call test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes 1.76s call test_freeze_table/test.py::test_freeze_table 1.75s call test_keeper_four_word_command/test_allow_list.py::test_allow_list 1.63s call test_grant_and_revoke/test.py::test_current_database 1.61s call test_library_bridge/test.py::test_path_validation 1.50s call test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk 1.45s call test_library_bridge/test.py::test_load_keys 1.16s call test_grant_and_revoke/test.py::test_smoke 1.10s call test_grant_and_revoke/test.py::test_grant_all_on_table 1.09s call test_grant_and_revoke/test.py::test_implicit_create_temporary_table_grant 1.04s call test_keeper_four_word_command/test.py::test_cmd_ydld 1.03s call test_keeper_four_word_command/test.py::test_cmd_rqld 0.99s call test_insert_over_http_query_log/test.py::test_insert_over_http_unknown_table 0.95s call test_max_rows_to_read_leaf_with_view/test.py::test_max_rows_to_read_leaf_via_view 0.93s call test_insert_into_distributed_through_materialized_view/test.py::test_inserts_local 0.83s call test_keeper_four_word_command/test.py::test_cmd_mntr 0.82s call test_library_bridge/test.py::test_null_values 0.81s call test_keeper_four_word_command/test.py::test_cmd_lgif 0.75s call test_fetch_memory_usage/test.py::test_huge_column 0.75s call test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used 0.74s call test_insert_over_http_query_log/test.py::test_insert_over_http_invalid_statement 0.70s call test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin 0.48s call test_library_bridge/test_exiled.py::test_bridge_dies_with_parent 0.44s teardown test_grant_and_revoke/test.py::test_introspection 0.43s teardown test_grant_and_revoke/test.py::test_revoke_requires_grant_option 0.41s call test_keeper_four_word_command/test.py::test_cmd_crst 0.38s teardown test_grant_and_revoke/test.py::test_implicit_create_view_grant 0.38s teardown test_grant_and_revoke/test.py::test_allowed_grantees 0.38s teardown test_grant_and_revoke/test.py::test_grant_all_on_table 0.38s call test_keeper_availability_zone/test.py::test_get_availability_zone 0.37s teardown test_grant_and_revoke/test.py::test_implicit_show_grants 0.33s teardown test_grant_and_revoke/test.py::test_current_grants_override 0.33s teardown test_grant_and_revoke/test.py::test_grant_current_grants 0.33s teardown test_grant_and_revoke/test.py::test_current_database 0.33s teardown test_grant_and_revoke/test.py::test_grant_current_grants_with_partial_revoke 0.33s teardown test_grant_and_revoke/test.py::test_grant_option 0.33s teardown test_grant_and_revoke/test.py::test_implicit_create_temporary_table_grant 0.33s teardown test_grant_and_revoke/test.py::test_grant_with_replace_option 0.33s call test_keeper_four_word_command/test.py::test_cmd_stat 0.32s call test_keeper_secure_client/test.py::test_connection 0.31s call test_keeper_four_word_command/test.py::test_cmd_cons 0.28s call test_keeper_four_word_command/test.py::test_cmd_dump 0.28s call test_keeper_four_word_command/test.py::test_cmd_wchc 0.28s call test_keeper_four_word_command/test.py::test_cmd_srvr 0.25s call test_keeper_four_word_command/test.py::test_cmd_wchs 0.24s call test_keeper_four_word_command/test.py::test_cmd_wchp 0.22s call test_library_bridge/test.py::test_ssrf 0.22s call test_keeper_and_access_storage/test.py::test_create_replicated 0.22s call test_keeper_four_word_command/test.py::test_cmd_clrs 0.18s call test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 0.14s call test_keeper_four_word_command/test.py::test_cmd_srst 0.13s call test_keeper_four_word_command/test.py::test_cmd_csnp 0.12s call test_keeper_four_word_command/test.py::test_cmd_conf 0.10s call test_keeper_session/test.py::test_session_timeout 0.09s call test_http_native/test.py::test_http_native_returns_timezone 0.02s call test_keeper_four_word_command/test.py::test_cmd_isro 0.01s call test_keeper_four_word_command/test.py::test_cmd_ruok 0.00s teardown test_jbod_balancer/test.py::test_jbod_balanced_merge 0.00s setup test_library_bridge/test.py::test_server_restart_bridge_might_be_still_alive 0.00s teardown test_merge_tree_load_parts/test.py::test_merge_tree_load_parts 0.00s setup test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted 0.00s teardown test_inserts_with_keeper_retries/test.py::test_query_timeout_with_zk_down 0.00s teardown test_keeper_persistent_log/test.py::test_ephemeral_after_restart 0.00s setup test_library_bridge/test.py::test_ssrf 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_wchp 0.00s teardown test_keeper_s3_snapshot/test.py::test_s3_upload 0.00s setup test_lost_part/test.py::test_lost_part_same_replica 0.00s setup test_insert_over_http_query_log/test.py::test_insert_over_http_ok 0.00s setup test_grant_and_revoke/test.py::test_grant_all_on_table 0.00s teardown test_lost_part/test.py::test_lost_last_part 0.00s teardown test_keeper_persistent_log/test.py::test_state_after_restart 0.00s setup test_lost_part/test.py::test_lost_part_mutation 0.00s setup test_insert_over_http_query_log/test.py::test_insert_over_http_unknown_table 0.00s setup test_grant_and_revoke/test.py::test_grant_option 0.00s setup test_keeper_four_word_command/test.py::test_cmd_csnp 0.00s setup test_grant_and_revoke/test.py::test_grant_current_grants 0.00s setup test_keeper_four_word_command/test.py::test_cmd_crst 0.00s teardown test_library_bridge/test.py::test_server_restart_bridge_might_be_still_alive 0.00s setup test_keeper_four_word_command/test.py::test_cmd_wchs 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_lgif 0.00s setup test_grant_and_revoke/test.py::test_grant_current_grants_with_partial_revoke 0.00s teardown test_insert_over_http_query_log/test.py::test_insert_over_http_exception[0] 0.00s setup test_grant_and_revoke/test.py::test_revoke_requires_grant_option 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_wchs 0.00s setup test_grant_and_revoke/test.py::test_introspection 0.00s setup test_grant_and_revoke/test.py::test_implicit_show_grants 0.00s setup test_keeper_four_word_command/test.py::test_cmd_srvr 0.00s setup test_keeper_four_word_command/test.py::test_cmd_dump 0.00s setup test_keeper_four_word_command/test.py::test_cmd_conf 0.00s setup test_keeper_four_word_command/test.py::test_cmd_mntr 0.00s setup test_keeper_session/test.py::test_session_timeout 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_ruok 0.00s setup test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin 0.00s setup test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_clrs 0.00s setup test_keeper_four_word_command/test.py::test_cmd_cons 0.00s setup test_keeper_persistent_log/test.py::test_state_after_restart 0.00s teardown test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size 0.00s setup test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_disconnect 0.00s setup test_grant_and_revoke/test.py::test_current_grants_override 0.00s setup test_grant_and_revoke/test.py::test_current_database 0.00s setup test_insert_over_http_query_log/test.py::test_insert_over_http_invalid_statement 0.00s setup test_keeper_four_word_command/test.py::test_cmd_srst 0.00s teardown test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk 0.00s teardown test_keeper_internal_secure/test.py::test_secure_raft_works 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_cons 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_dump 0.00s setup test_lost_part/test.py::test_lost_part_other_replica 0.00s setup test_grant_and_revoke/test.py::test_smoke 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_crst 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_conf 0.00s setup test_keeper_four_word_command/test.py::test_cmd_isro 0.00s teardown test_log_family_s3/test.py::test_log_family_s3[Log] 0.00s teardown test_insert_over_http_query_log/test.py::test_insert_over_http_exception[1] 0.00s setup test_keeper_four_word_command/test.py::test_cmd_wchp 0.00s teardown test_insert_over_http_query_log/test.py::test_insert_over_http_ok 0.00s teardown test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 0.00s setup test_library_bridge/test.py::test_null_values 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_mntr 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_srst 0.00s setup test_insert_over_http_query_log/test.py::test_insert_over_http_exception[1] 0.00s teardown test_insert_over_http_query_log/test.py::test_insert_over_http_invalid_statement 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_wchc 0.00s setup test_grant_and_revoke/test.py::test_implicit_create_temporary_table_grant 0.00s teardown test_lost_part/test.py::test_lost_part_other_replica 0.00s setup test_library_bridge/test.py::test_load_all_many_rows 0.00s setup test_memory_limit_observer/test.py::test_observe_memory_limit 0.00s setup test_keeper_four_word_command/test.py::test_cmd_stat 0.00s teardown test_log_family_s3/test.py::test_log_family_s3[TinyLog] 0.00s teardown test_lost_part/test.py::test_lost_part_mutation 0.00s setup test_grant_and_revoke/test.py::test_implicit_create_view_grant 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_stat 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_csnp 0.00s setup test_keeper_four_word_command/test.py::test_cmd_lgif 0.00s setup test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes 0.00s setup test_keeper_four_word_command/test.py::test_cmd_wchc 0.00s setup test_library_bridge/test.py::test_load_keys 0.00s teardown test_keeper_session/test.py::test_session_close_shutdown 0.00s setup test_grant_and_revoke/test.py::test_grant_with_replace_option 0.00s teardown test_library_bridge/test.py::test_load_keys 0.00s teardown test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted 0.00s setup test_keeper_internal_secure/test.py::test_secure_raft_works_with_password 0.00s setup test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_restart 0.00s teardown test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_disconnect 0.00s teardown test_library_bridge/test.py::test_load_all 0.00s teardown test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used 0.00s setup test_library_bridge/test.py::test_path_validation 0.00s setup test_library_bridge/test.py::test_load_ids 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_isro 0.00s setup test_keeper_persistent_log/test.py::test_state_duplicate_restart 0.00s setup test_keeper_four_word_command/test.py::test_cmd_ruok 0.00s teardown test_log_family_s3/test.py::test_log_family_s3[StripeLog] 0.00s setup test_log_family_s3/test.py::test_log_family_s3[StripeLog] 0.00s setup test_keeper_four_word_command/test.py::test_cmd_ydld 0.00s setup test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk 0.00s setup test_keeper_four_word_command/test.py::test_cmd_rqld 0.00s setup test_library_bridge/test.py::test_recover_after_bridge_crash 0.00s setup test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_srvr 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_rqld 0.00s setup test_log_family_s3/test.py::test_log_family_s3[TinyLog] 0.00s teardown test_library_bridge/test.py::test_load_ids 0.00s teardown test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes 0.00s teardown test_library_bridge/test.py::test_null_values 0.00s teardown test_library_bridge/test.py::test_recover_after_bridge_crash 0.00s teardown test_library_bridge/test.py::test_path_validation 0.00s teardown test_library_bridge/test.py::test_load_all_many_rows =========================== short test summary info ============================ ERROR test_log_family_s3/test.py::test_log_family_s3[Log] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_log_family_s3/test.py::test_log_family_s3[StripeLog] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_log_family_s3/test.py::test_log_family_s3[TinyLog] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/.env', '--project-name', 'roottestlogfamilys3', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_keeper_s3_snapshot/test.py::test_s3_upload - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/.env', '--project-name', 'roottestkeepers3snapshot', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_s3_snapshot/_instances_0/node3/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used PASSED test_keeper_four_word_command/test.py::test_cmd_clrs PASSED test_keeper_four_word_command/test.py::test_cmd_conf PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes PASSED test_keeper_four_word_command/test.py::test_cmd_cons PASSED test_keeper_four_word_command/test.py::test_cmd_crst PASSED test_keeper_four_word_command/test.py::test_cmd_csnp PASSED test_keeper_four_word_command/test.py::test_cmd_dump PASSED test_keeper_four_word_command/test.py::test_cmd_isro PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk PASSED test_keeper_four_word_command/test.py::test_cmd_lgif PASSED test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin PASSED test_keeper_four_word_command/test.py::test_cmd_mntr PASSED test_grant_and_revoke/test.py::test_allowed_grantees PASSED test_keeper_persistent_log/test.py::test_ephemeral_after_restart PASSED test_keeper_four_word_command/test.py::test_cmd_rqld PASSED test_keeper_four_word_command/test.py::test_cmd_ruok PASSED test_keeper_four_word_command/test.py::test_cmd_srst PASSED test_keeper_four_word_command/test.py::test_cmd_srvr PASSED test_keeper_four_word_command/test.py::test_cmd_stat PASSED test_keeper_four_word_command/test.py::test_cmd_wchc PASSED test_grant_and_revoke/test.py::test_current_database PASSED test_keeper_four_word_command/test.py::test_cmd_wchp PASSED test_keeper_four_word_command/test.py::test_cmd_wchs PASSED test_insert_over_http_query_log/test.py::test_insert_over_http_exception[0] PASSED test_keeper_four_word_command/test.py::test_cmd_ydld PASSED test_grant_and_revoke/test.py::test_current_grants_override PASSED test_insert_over_http_query_log/test.py::test_insert_over_http_exception[1] PASSED test_lost_part/test.py::test_lost_last_part PASSED test_insert_over_http_query_log/test.py::test_insert_over_http_invalid_statement PASSED test_grant_and_revoke/test.py::test_grant_all_on_table PASSED test_keeper_persistent_log/test.py::test_state_after_restart PASSED test_insert_over_http_query_log/test.py::test_insert_over_http_ok PASSED test_insert_over_http_query_log/test.py::test_insert_over_http_unknown_table PASSED test_grant_and_revoke/test.py::test_grant_current_grants PASSED test_library_bridge/test.py::test_load_all PASSED test_grant_and_revoke/test.py::test_grant_current_grants_with_partial_revoke PASSED test_grant_and_revoke/test.py::test_grant_option PASSED test_keeper_persistent_log/test.py::test_state_duplicate_restart PASSED test_library_bridge/test.py::test_load_all_many_rows PASSED test_grant_and_revoke/test.py::test_grant_with_replace_option PASSED test_library_bridge/test.py::test_load_ids PASSED test_grant_and_revoke/test.py::test_implicit_create_temporary_table_grant PASSED test_library_bridge/test.py::test_load_keys PASSED test_library_bridge/test.py::test_null_values PASSED test_library_bridge/test.py::test_path_validation PASSED test_grant_and_revoke/test.py::test_implicit_create_view_grant PASSED test_merge_tree_load_parts/test.py::test_merge_tree_load_parts PASSED test_keeper_session/test.py::test_session_close_shutdown PASSED test_keeper_session/test.py::test_session_timeout PASSED test_grant_and_revoke/test.py::test_implicit_show_grants PASSED test_inserts_with_keeper_retries/test.py::test_query_timeout_with_zk_down PASSED test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_disconnect PASSED test_grant_and_revoke/test.py::test_introspection PASSED test_drop_replica_with_auxiliary_zookeepers/test.py::test_drop_replica_in_auxiliary_zookeeper PASSED test_jbod_balancer/test.py::test_jbod_balanced_merge PASSED test_keeper_internal_secure/test.py::test_secure_raft_works PASSED test_grant_and_revoke/test.py::test_revoke_requires_grant_option PASSED test_library_bridge/test.py::test_recover_after_bridge_crash PASSED test_grant_and_revoke/test.py::test_smoke PASSED test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted PASSED test_drop_if_empty/test.py::test_drop_if_empty PASSED test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_restart PASSED test_insert_into_distributed_through_materialized_view/test.py::test_inserts_local PASSED test_lost_part/test.py::test_lost_part_mutation PASSED test_failed_async_inserts/test.py::test_failed_async_inserts PASSED test_fix_metadata_version/test.py::test_fix_metadata_version PASSED test_freeze_table/test.py::test_freeze_table PASSED test_keeper_availability_zone/test.py::test_get_availability_zone PASSED test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch PASSED test_group_array_element_size/test.py::test_max_exement_size PASSED test_http_native/test.py::test_http_native_returns_timezone PASSED test_keeper_and_access_storage/test.py::test_create_replicated PASSED test_keeper_mntr_data_size/test.py::test_mntr_data_size_after_restart PASSED test_keeper_internal_secure/test.py::test_secure_raft_works_with_password PASSED test_library_bridge/test.py::test_server_restart_bridge_might_be_still_alive PASSED test_keeper_force_recovery_single_node/test.py::test_cluster_recovery PASSED test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts PASSED test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size PASSED test_memory_limit_observer/test.py::test_observe_memory_limit PASSED test_keeper_four_word_command/test_allow_list.py::test_allow_list PASSED test_keeper_nodes_move/test.py::test_node_move PASSED test_keeper_secure_client/test.py::test_connection PASSED test_jbod_ha/test.py::test_jbod_ha PASSED test_host_regexp_multiple_ptr_records_concurrent/test.py::test_host_regexp_multiple_ptr_v4 PASSED test_keeper_force_recovery/test.py::test_cluster_recovery PASSED test_keeper_mntr_pressure/test.py::test_aggressive_mntr PASSED test_lost_part/test.py::test_lost_part_other_replica PASSED test_lost_part/test.py::test_lost_part_same_replica PASSED test_max_rows_to_read_leaf_with_view/test.py::test_max_rows_to_read_leaf_via_view PASSED test_keeper_reconfig_add/test.py::test_reconfig_add SKIPPED [1] test_merge_tree_load_parts/test.py:227: Skip with debug build and sanitizers. This test intentionally triggers LOGICAL_ERROR which leads to crash with those builds SKIPPED [1] test_fetch_memory_usage/test.py:26: sanitizer build has higher memory consumption; also it is slow SKIPPED [1] test_library_bridge/test.py:338: Sanitizer cannot work with third-party shared libraries SKIPPED [1] test_library_bridge/test_exiled.py:53: Leak sanitizer falsely reports about a leak of 16 bytes in clickhouse-odbc-bridge ======== 91 passed, 4 skipped, 1 warning, 5 errors in 464.21s (0:07:44) ======== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 437, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_zg7bhh --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=2993bc2bf171 -e DOCKER_KERBERIZED_HADOOP_TAG=ce74919e88f5 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=a2d3dc777d0c -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_drop_if_empty/test.py::test_drop_if_empty test_drop_replica_with_auxiliary_zookeepers/test.py::test_drop_replica_in_auxiliary_zookeeper test_failed_async_inserts/test.py::test_failed_async_inserts test_fetch_memory_usage/test.py::test_huge_column test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts test_fix_metadata_version/test.py::test_fix_metadata_version test_freeze_table/test.py::test_freeze_table test_grant_and_revoke/test.py::test_allowed_grantees test_grant_and_revoke/test.py::test_current_database test_grant_and_revoke/test.py::test_current_grants_override test_grant_and_revoke/test.py::test_grant_all_on_table test_grant_and_revoke/test.py::test_grant_current_grants test_grant_and_revoke/test.py::test_grant_current_grants_with_partial_revoke test_grant_and_revoke/test.py::test_grant_option test_grant_and_revoke/test.py::test_grant_with_replace_option test_grant_and_revoke/test.py::test_implicit_create_temporary_table_grant test_grant_and_revoke/test.py::test_implicit_create_view_grant test_grant_and_revoke/test.py::test_implicit_show_grants test_grant_and_revoke/test.py::test_introspection test_grant_and_revoke/test.py::test_revoke_requires_grant_option test_grant_and_revoke/test.py::test_smoke test_group_array_element_size/test.py::test_max_exement_size test_host_regexp_multiple_ptr_records_concurrent/test.py::test_host_regexp_multiple_ptr_v4 test_http_native/test.py::test_http_native_returns_timezone test_insert_into_distributed_through_materialized_view/test.py::test_inserts_local 'test_insert_over_http_query_log/test.py::test_insert_over_http_exception[0]' 'test_insert_over_http_query_log/test.py::test_insert_over_http_exception[1]' test_insert_over_http_query_log/test.py::test_insert_over_http_invalid_statement test_insert_over_http_query_log/test.py::test_insert_over_http_ok test_insert_over_http_query_log/test.py::test_insert_over_http_unknown_table test_inserts_with_keeper_retries/test.py::test_query_timeout_with_zk_down test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_disconnect test_inserts_with_keeper_retries/test.py::test_replica_inserts_with_keeper_restart test_jbod_balancer/test.py::test_jbod_balanced_merge test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch test_jbod_ha/test.py::test_jbod_ha test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_detect_background_changes test_jbod_load_balancing/test.py::test_jbod_load_balancing_least_used_next_disk test_jbod_load_balancing/test.py::test_jbod_load_balancing_round_robin test_keeper_and_access_storage/test.py::test_create_replicated test_keeper_availability_zone/test.py::test_get_availability_zone test_keeper_force_recovery/test.py::test_cluster_recovery test_keeper_force_recovery_single_node/test.py::test_cluster_recovery test_keeper_four_word_command/test.py::test_cmd_clrs test_keeper_four_word_command/test.py::test_cmd_conf test_keeper_four_word_command/test.py::test_cmd_cons test_keeper_four_word_command/test.py::test_cmd_crst test_keeper_four_word_command/test.py::test_cmd_csnp test_keeper_four_word_command/test.py::test_cmd_dump test_keeper_four_word_command/test.py::test_cmd_isro test_keeper_four_word_command/test.py::test_cmd_lgif test_keeper_four_word_command/test.py::test_cmd_mntr test_keeper_four_word_command/test.py::test_cmd_rqld test_keeper_four_word_command/test.py::test_cmd_ruok test_keeper_four_word_command/test.py::test_cmd_srst test_keeper_four_word_command/test.py::test_cmd_srvr test_keeper_four_word_command/test.py::test_cmd_stat test_keeper_four_word_command/test.py::test_cmd_wchc test_keeper_four_word_command/test.py::test_cmd_wchp test_keeper_four_word_command/test.py::test_cmd_wchs test_keeper_four_word_command/test.py::test_cmd_ydld test_keeper_four_word_command/test_allow_list.py::test_allow_list test_keeper_internal_secure/test.py::test_secure_raft_works test_keeper_internal_secure/test.py::test_secure_raft_works_with_password test_keeper_mntr_data_size/test.py::test_mntr_data_size_after_restart test_keeper_mntr_pressure/test.py::test_aggressive_mntr test_keeper_nodes_move/test.py::test_node_move test_keeper_persistent_log/test.py::test_ephemeral_after_restart test_keeper_persistent_log/test.py::test_state_after_restart test_keeper_persistent_log/test.py::test_state_duplicate_restart test_keeper_reconfig_add/test.py::test_reconfig_add test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 test_keeper_s3_snapshot/test.py::test_s3_upload test_keeper_secure_client/test.py::test_connection test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout test_library_bridge/test.py::test_load_all test_library_bridge/test.py::test_load_all_many_rows test_library_bridge/test.py::test_load_ids test_library_bridge/test.py::test_load_keys test_library_bridge/test.py::test_null_values test_library_bridge/test.py::test_path_validation test_library_bridge/test.py::test_recover_after_bridge_crash test_library_bridge/test.py::test_server_restart_bridge_might_be_still_alive test_library_bridge/test.py::test_ssrf test_library_bridge/test_exiled.py::test_bridge_dies_with_parent 'test_log_family_s3/test.py::test_log_family_s3[Log]' 'test_log_family_s3/test.py::test_log_family_s3[StripeLog]' 'test_log_family_s3/test.py::test_log_family_s3[TinyLog]' test_lost_part/test.py::test_lost_last_part test_lost_part/test.py::test_lost_part_mutation test_lost_part/test.py::test_lost_part_other_replica test_lost_part/test.py::test_lost_part_same_replica test_max_rows_to_read_leaf_with_view/test.py::test_max_rows_to_read_leaf_via_view test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size test_memory_limit_observer/test.py::test_observe_memory_limit test_merge_tree_load_parts/test.py::test_merge_tree_load_parts test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_corrupted test_merge_tree_load_parts/test.py::test_merge_tree_load_parts_filesystem_error -vvv" altinityinfra/integration-tests-runner:9d492c2eec24 ' returned non-zero exit status 1.